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Abstract 

We have discussed dynamical properties of the Tsallis entropy and the general- 
ized Fisher information in nonextensive systems described by the Langevin model 
subjected to additive and multiplicative noise. Analytical expressions for the time- 
dependent Tsallis entropy and generalized Fisher information have been obtained 
with the use of the g-moment approach to the Fokker-Planck equation developed 
in a previous study [H. Hasegawa, Phys. Rev. E 77, 031133 (2008)]. Model calcu- 
lations of the information entropies in response to an applied pulse and sinusoidal 
inputs have been presented. 
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1 Introduction 



Information entropies in nonextensive systems have been extensively investigated since 
Tsallis [H E] proposed the generahzed entropy (called Tsallis entropy hereafter) defined 
by 

S, = Jp{x,tydx^, (1) 

where q is the entropic parameter and p{x, t) denotes the probability distribution of a 
state variable x at time t. The Tsallis entropy is not extensive for g 7^ 1.0 in the sense 
that the total entropy of a given system is not proportional to the number of constituent 
elements. In the limit of g = 1.0, Sg reduces to the Boltzmann-Gibbs-Shannon entropy. 
The generalized Fisher information, which is derived for the generalized Kullback-Leibler 
divergence in conformity with the Tsallis entropy, is expressed by [3]-|15j 



9ij 



qE 



91np(x,t)\ /(91np(a;,t) 



(2) 



where E[-] denotes the average over the probability p{x,t) characterized by a set of pa- 
rameters of {di}- The Tsallis entropy and the generalized Fisher information provide the 
important measure of the information in nonextensive systems. The Boltzman-Gibbs- 
Shannon-Tsallis entropy represents a global measure of ignorance while the Fisher infor- 
mation expresses a local measure of positive amount of information [16]. In particular, 
the Fisher information signifies the distance between the neighboring points in the Rie- 
mann space spanned by probability distributions in the information geometry. Its inverse 
expresses the lower bound of the decoding error for unbiased estimator in the Cramer- Rao 
inequality. 

In a previous paper [T5] (referred to as I hereafter), we calculated the Tsallis entropy 
and generalized Fisher information in a microscopic nonextensive system described by the 
Langevin model subjected to additive and multiplicative noise. Employing an analytic 
time-dependent solution of the relevant Fokker-Planck equation (FPE), we discussed the 
stationary and dynamical properties of the Tsallis entropy Sq and the generalized Fisher 
information g^x given by 
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' dlnp{x, t) 
dx 



(3) 



in stead of Qij given by Eq. ([2]). Recently Konno and Watanabe [17] have made a 
detailed study of the Fisher information gij in the stationary state of the Langevin model 
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subjected to cross-correlated additive and multiplicative noise, related discussion being 
given in Sec. 4. It is worthwhile to investigate the dynamics of various elements of 
the generalized Fisher information Qij besides g^^. The purpose of the present paper is 
to perform detailed calculations of the time-dependent Tsallis entropy and generalized 
Fisher information with the use of the analytic g-moment approach to the FPE which 
was previously developed in I. 

The paper is organized as follows. In Section 2, we discuss the adopted Langevin 
model and ^-moment method to obtain the analytic solution of the FPE. With the use of 
the calculated time-dependent distributions, analytical expressions for the Tsallis entropy 
and generalized Fisher information are derived in Section 3. In Section 4, we present some 
model calculations of noise-intensity dependences of the generalized Fisher information in 
the stationary state as well as the dynamical response of Tsallis entropy and generalized 
Fisher information to an applied pulse and sinusoidal inputs. Section 5 is devoted to 
conclusion and discussion on relevant previous studies. 

2 Adopted model and method 
2.1 The Fokker-Planck equation 

We have adopted the Langevin model subjected to additive (^) and multiplicative noise 
(rj) given by 



where F{x) and G{x) are arbitrary functions of x, I{t) stands for an external input, and 
ri{t) and ^(t) express zero-mean Gaussian white noises with correlations given by 



a and (3 denoting the strengths of multiplicative and additive noises, respectively. 
The FPE in the Stratonovich representation is expressed by 
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Although we have adopted the single-variable Langevin model in this study, it is straight- 
forward to extend it to the coupled Langevin model with the use of the mean-field ap- 
proximation [15] . 



2.2 Stationary distribution 

For the linear Langevin model given by 

F{x) = -Ax, (9) 
G{x) = X, (10) 

where A denotes the relaxation rate, the stationary probability distribution p{x) is ex- 
pressed by [T5] 



with 



p{x) 



q-1 
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exp[y(a;)]. 



(2A + a2) ' 
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Y{x) = 2c tan"^ 
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a/3' 
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X 



|r(-^ + ^c) p 



(11) 

(12) 
(13) 

(14) 

(15) 

(16) 



where T{z) denotes the gamma function. In deriving Eq. (|T6l) . we have employed the 
following formula [T7] : 
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(17) 
(18) 



To make the expression of p{x) compact, we have introduced new parameters a and b, 
defined by 
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(2A + a2) 
2a2 



(19) 
(20) 



which lead to 

1 \ exp [2c tan^"'^(aa;)] 
.z) (1 + a2x2 

with 

^ v/?r(&)r(6-i) 

a I r(6 + ic) |2 
We define the nth g-moment defined by 



P(-) = (±) -^;--^;-^J , (21) 



(22) 



Ejx"] = jPq{x)x'^dx, (23) 
where -E^f-] expresses the average over the escort distribution Pq{x) given by 

P,{x) = (24) 

Cq 

Cq = j p{xy dx, (25) 

while E[-] denotes the average over p{x) [e.g. Eq. ([2])]. By using Eqs. fl23l) - fl25l) for the 
stationary distribution given by Eq. ( !2TI) . we may obtain the variance fiq (= -Eg[a;]) and 
covariance (= Eq[x^] — Eqlx]"^) in the stationary state given by 

_ £(6 + 1) _ 2(2A + 3a^ ^ / 



a262(26-l) 2A 



Depending on the model parameters, the stationary distribution given by Eq. (fTTi) 
or (12T|) may reproduce various distributions such as the Gaussian (g = 1.0), g-Gaussian 
(g 7^ 1.0, c = 0.0), Cauchy (g = 2.0, c 7^ 0.0) and inverse-gamma distributions (/? = 0.0, 
c^O.O) 



2.3 Dynamical distribution 

In order to obtain the dynamical solution of the FPE given by Eq. ([8]), we have adopted 
the following g-moment approach [15]. 

(1) From an equation of motion for the nth g-moment of -E'g[a;"] given by Eq. 



dt dt 

Iff dp{x, t) 



dcq f j dp{x, t) 



dt J \ dt 



J Pq{x,t) x"" dx, (28) 
^ pix,ty-' x-dx-^ (^^j Eq[x% (29) 

p{x,ty-^dx, (30) 



Cq J \ dt 



we have derived equations of motion for fiq(t) and <Jq(t)^ given by [T5 



dt 
daqitf 



-Xflqit)+I{t), (31) 

-2Xaq{tf + a^jjgity + (3^. (32) 



dt 

(2) We have assumed that the dynamical distribution has the same functional form as 
that of the stationary one, 

_ 1 exp[2c(t) tan-^ a(t)x] 
^^"^'^^ " Z{t) [l + a{tyx^]^ ' ^^^^ 

with the time-independent b [= !/((?— 1)] and the time-depedent a{t) and c(t) given by 
[15] 

"^'^ = [(26-l)a,(t)^-^,(t)2]i/2' (34) 
c(t) = "('^"^^^^^(^^ (35) 

Ar(&)r(fe-i) 

where //^(t) and CTqitY obey equations of motion given by Eqs. fl3T]) and fl32l) . Equations 
( !34|) and (l35|l are derived from the relations for the stationary state given by Eqs. ( l26l) 
and (EZD after I (see Eqs. (86)- (90) in Ref. [15]). 

With the assumption (2), we once tried to derive equations of motion for a(t), 6(t), 
c{t) and Z{t) from the FPE, but failed: they are not determined in an appropriate way 
|15j . Then we have decided to express the parameters of a{t) and c{t) in terms of ^q{t) 
and (Tqity, as given by Eqs. (IMl) and (jHSD- The time-dependent distributions calculated 
by Eqs. fl31l) - fl36l) are in good agreement with those obtained by the partial difference 
equation method (PDE), as was discussed in I (see Fig. 7 of Ref. [15]) and will be shown 
shortly (Fig. [2]). 

3 Information entropies 
3.1 Tsallis Entropy 

In a previous study [T5], we numerically calculated the Tsallis entropy Sq given by Eq. 
([T]). By using the time- dependent distribution p{x,t) given by Eq. ( !33l) . we may obtain 
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analytical expression for Sq given by 

1 



Sq = -[l + ln(2vra,^)] (for g = 1), (37) 



1 - Cg 



(for q ^ 1), (38) 



with 



' \2[b^ + iqcy]) \T{b + iqc)\^' ^ ' 

where Z is given by Eq. ( l36ll . 

3.2 Generalized Fisher information 

In order to derive the analytic expression for the generalized Fisher information, we first 
calculate the derivatives of lnp(x, t) with respect to 6^ = (a, b, c), as given by (the argument 
t in a and b being suppressed), 

ainp(.,t) ,Jl\^22(V.(2b-l)^ ^^^^ 



da 




dlnp^x, 


t) 


db 




d\np{x, 


t) 


dc 



with 



U J a \U J a 
-\nU + A, (41) 

2tan~^(ax) - 5, (42) 



U = 1 + (43) 
A = 2Rei;{b + ic) -ip{b) -i;{b- 1/2), (44) 
B = 2lmtp{b + ic), (45) 



where the relation given by x'^/U = (1 — l/f/)/a^ is employed. Substituting Eqs. (H0!) - (H2l) 
to Eq. ([2]) and evaluating various averages such as E[l/U] and i?[lnf/] after the method 
mentioned in the Appendix A (and the Table 1), we have obtained the generalized Fisher 
information matrix G, whose elements gij [= {G)ij] are expressed by 

_ q{2b-l){b+l + C^) 
^'^'^ " a2[(6 + l)2 + c2] ' ^^""^ 
9bb = q[ip'{b)+^'{b-l/2)-2Re^'{b + tc)], (47) 

5ec = 2qRe^'{b + tc), (48) 
q{b + 2c^) . . 

gab = Qba = .,0 I 2^ ' (^9) 
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qc{2b - 1) 

9ac — Qca — /, 9 , ^) l^Uj 

= 5'cb = 2glm^'(6 + ic). (51) 



In the limit of c = 0, Eqs. ( l46i) -( l5Til reduce to 



_ g(26-l) 

^"'^ " a2(6 + l)' ^^^^ 

^766 = g[^'(6-l/2)-^'(6)], (53) 

g,, = 2q^'{b), (54) 

= 9ba = (55) 



and = otherwise. 



4 Model calculations 
4.1 Stationary properties 

By using Eqs. ( l46l) -( !5TI) . we have performed some model calculations of the generalized 
Fisher information matrix G, whose dependences on a, (3 and I are plotted in Fig. [T](a)- 
(f): relevant calculations of the Tsallis entropy were presented in I (see Figs. 2, 3 and 4 
in Ref. [15]). 

(a) a dependence 

First we show in Figs. [11(a) and (b), the diagonal and off-diagonal elements of G as a 
function of for (3 = 0.5 and / = 1.0. We note that with increasing a, Qaa is significantly 
decreased while gbb and gcc are increased. \gbc\ is gradually increased with a negative sign 
whereas the saturation behavior is realized in gab and gac for a large a. 

(b) P dependence 

Figures [T](c) and (d) show the /3 dependence of the diagonal and off-diagonal elements, 
respectively, of G for a = 0.5 and / = 1.0. With increasing P, gaa and gcc are increased 
whereas gbb is decreased. Off-diagonal elements are small at /5 = 0.0. With increasing 
P from zero value, gab is increased with a positive sign while \gbc\ and \gac\ are increased 
with negative signs. 

(c) I dependence 

The / dependences of diagonal and off-diagonal elements of G are plotted in Figs. 
[U^e) and (f), respectively. With increasing /, both gaa and gbb are increased whereas gcc 
is decreased. Although off-diagonal elements are vanishing at / = 0.0 except for gab as 
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Eq. (!55|) shows, a positive gab is increased while \gbc\ and \gac\ are increased with negative 
signs when I is increased. 

4.2 Dynamical properties 

We will discuss the response of the system to applied external signals in this subsection. 
In order to examine the validity of the analytic dynamical approach, we have employed 
the PDE derived from Eq. ([8]), as given by 

p{x,t + v) = p{x,t)+(^-F'{x) + ^[G'{xf + G{x)G^^\x)]^vp{x,t) 



+ 



-F{x)-I{t) + ^G{x)G\x) 



V 



— ) [p{x + u) - p{x - u)] 



+ (yG(x)2 + ^j (^^) [p(x + M,t)+p(a;-M,t)-2p(x,t)], (56) 



where u and v denote incremental steps of x and t, respectively. We impose the boundary 
condition: 

p{x,t) = 0, for I X |> Xm (57) 

with Xm = 5, and the initial condition of p{x,0) = Po{x) where po{x) is the stationary 
distribution given by Eqs. fl^Tl) and fl22]) . We have chosen parameters of u = 0.05 and 
V = 0.0001 such as to satisfy the condition: {a'^x'^v/2u^) < 1/2, which is required for 
stable, convergent solutions of the PDE [15] . 

(a) Pulse Input 

We first apply a pulse input given by 

I{t) = A/ [e(t- 2)0(6 -t) -e(t- 10)9(14 -t)], (58) 

to a system with A = 1.0, a = 0.5 and (3 = 0.5, where A/ = 1.0 and Q{x) denotes the 
Heaviside function: Q{x) = 1 for x > 1 and zero for x < 0. Positive and negative pulses 
with the magnitude of |A/| are applied at 2.0 <t< 6.0 and 10.0 <t< 14.0, respectively. 
The time-dependent distributions of p{x,t) at < t < 10.0 are plotted in Fig. [21 where 
solid (dashed) curves express the results of the g-moment (PDE) method [TSj. By a 
positive pulse applied at 2.0 < t < 6.0, p{x,t) moves rightward with a slight modification 
of its shape. In contrast, when a negative pulse is applied at 10.0 < t < 14.0, p{x,t) 
moves leftward again with a slight modification of its shape. We note that the results 
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calculated by the g-moment method are in good agreement with those obtained by the 
PDE method. 

Figure [3]^a) shows the time dependence of and crg(t)^ in response to the applied 
pulse input. We note that Hq is increased (decreased) by an applied positive (negative) 
pulse whereas cr^ is increased for both positive and negative inputs. The result calculated 
with equations of motion given by Eqs. fl3Tl) and fl32|) shown by solid curves well agrees 
with those obtained by the PDE method shown by dashed curves. 

The Tsallis entropy Sq{t) in response to an applied pulse is plotted in Fig. [3]^b), where 
the solid and dashed curves express the results calculated by Eqs. ( l38l) and ( l39l) and by 
the PDE method, respectively. It is shown that Sq{t) is increased for both positive and 
negative input pulses. 

The time dependences of the diagonal and off-diagonal elements of the generalized 
Fisher information are plotted in Figs. ID^a) andlD^b), respectively. When a positive input 
signal is applied at 2.0 < t < 6.0, gaa, Qbb and gab are increased whereas Qcc, Qbc and Qac are 
decreased. When a negative input signal is applied at 10.0 < t < 14.0, all the elements 
except for Qac show the same behaviors as those for a positive input: only Qac is expressed 
by an odd function of c in Eqs. (I46l)-(15T]). 

Figure [5] shows the time dependence of inverse of the generalized Fisher information 
matrix, hij [= {G^^)ij]. With an applied pulse, hcc is increased while haa and hbb are de- 
creased. It implies from the Cramer-Rao theorem that when an external signal is applied, 
the lower bound in estimating the parameter c is increased while those in estimating a 
and b are decreased. 

(b ) Sinusoidal Input 

Next we apply a sinusoidal input given by 

m = A/sin(^^^^^^^^ 0(t-2)e(Tp + 2-t), (59) 

where AI = 1.0 and Tp = 10.0. The time dependences of yUg(t) and (TqitY in response to 
the apphed sinusoidal input are plotted in Figure [6](a), where bold and thin solid curves 
express the results calculated by Eqs. fl^ and (1521) . and where dashed curves show those 
obtained by the FPE method. The response of fiq{t) lags behind the input I{t) by about 
0.85. The time dependence of Sq(t) is plotted in Fig. Mjo), where solid and dashed curves 
denote the results of the g-moment and PDE methods, respectively. Figure [Tl^a) and 
(b) show the time dependences of diagonal and off-diagonal elements, respectively, of the 



10 



generalized Fisher information. A comparison of Figs. [6] and [7] to Figs. [3] and H] shows that 
time dependences of fi(t), <Jq{t)'^, Sq{t) and gij(t) for a sinusoidal input are not dissimilar 
to those for a pulse input. This is true also for the time dependence of the inversed Fisher 
information (relevant results not shown). 

5 Discussion and conclusion 

In a previous study [15], we numerically calculated the generalized Fisher information 
gxx given by Eq. ([3]). By using the dynamical distribution given by Eq. ( |33l) . we may 
analytically calculate g^x given by 

qa%{b + l){2b - 1) 



[{b + 1)2 + C2] ' 

qa%{2b-l) _ (3-g) _ 1 
(6 + 1) ~ 202 ~ 



(60) 

(for c = 0.0). (61) 



The time dependence of g^x when a pulse input given by Eq. (155]) is applied, is plotted 
by the chain curve in Fig. [H](a). 

For a comparison, we have calculated the generalized Fisher information for 6i = 6j = 
fiq and 9i = 9j = a'^ = •y in Eq. ([2]), by using the relations given by 



da\^ ( dc\^ ( da\ ( dc 



5^77 = 3aa, (63) 

where da/dfiq et. al. may be calculated from Eqs. ( |34]) and ( 135]) . Solid curves in Figs. 
Wi,a) and (b) show the time dependences of (7^^ and (7^^, respectively, in response of a 
pulse input given by Eq. (158]) . When an input pulse is applied, g^j,^ is decreased while g^^ 
is increased. We note that g^x and (7^^ are almost the same in the stationary state and 
that their responses to an input are similar apart from their magnitudes. 
It is well known that the relation given by 

gi^f, = gxx, (64) 
holds for q = 1.0 (a = 0.0) because the time-dependent Gaussian distribution is given by 

p{x,t) = , ^ ^-i^^mV2.itf ^ (g5) 

/27r(T(t)2 
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with yu(t) and o"(t)^ satisfying equations of motion given by 

dfi(t) 



dt 
da{t) 



Xfi{t) + I{t), (66) 



2 



2XcT{ty + f3\ (67) 
The relation given by Eq. 0641) is obtainable also for the g-Gaussian distribution given by 

1 1/(1-9) 

(68) 



(3-g)a,(t)^ 

which is derived from the maximum-entropy method for given /i^ and cr|. It is natural 
that Figs. [8](a) shows (7^^ 7^ g^^ for 7^ 0.0 because the distribution given by Eq. (l33l) 
is rather different from the g-Gaussian given by Eq. (|68l) except for c = fiq = 0.0 (see 
Figs. 10 and 11 of Ref. pjj). 

Although additive and multiplicative noise is assumed to be uncorrelated in Sec. 2, we 
may take into account effects of the cross- correlation between the two noise, introducing 
the degree of the cross-correlation e with (rjit) C,(t')) = ea[3 5{t — t') in place of Eq. ([7j). 
The stationary distribution is given by (for details, see the Appendix B) 

= m exp[2c tan"^a(x + /)] 
^ ' \Zj [I + a^^x + fy]' ^ ' 



with 



a 



(2A + a") 
2a2 ' 

{I + A/) 



e 



2' 



(70) 

(71) 
(72) 



/ - 'A (73) 
a 



Z . (74) 

a I r(o + ic) p 

The distribution given by Eq. fl69l) . which is shifted by an amount of / by an introduced 
cross-correlation, has the same dependence on the parameters a, h and c as that of Eq. 
( I2T]) . The Langevin model with the cross-correlated noise (e 7^ 0.0) but no external inputs 
(/ = 0.0) was discussed by Konno and Watanabe, who derived useful expressions for the 
generalized Fisher information in its stationary state [17] . 



^ The factor corresponding to e a(3G'{x) in the first term of Eq. (jB2p is missing in Eq. (23) of Konno 
and Watanabe K{x) = (a - Dp)x and / = 2(6 - l)c/A in Eqs. (23) and (25) of Ref. [17] should 
be replaced by K{x) = {a — Dp)x ~ Dap and / = (26— l)c/A, respectively. The probability distribution 
given by Eq. (27) of Ref. [17] is valid with these replacements. 
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Our result presented in this study may be applied to another type of the Langevin 
model, for example, with e = 0.0, and F{x) and G{x) given by 



F{x) = -\{x + s), (75) 

G{x) = Vr2 + 2sx + x2, (76) 

where A expresses the relaxation rate, and r and s are additional parameters. In the case 
of [P'^ + a^ir'^ — s^)] > 0, the stationary distribution is given by [I9] 



_ , 1 \ exp [2c tan ' a{x + s)] 
' ~ \Z) [l + a2(x + s)t ' 



with 



a 



(2A + g^) 

/ 

(^\J P"^ + Oi^ij"^ — s^) 

V^T{h)T{h-\) 

12 ■ 



(78) 

(79) 
(80) 

(81) 



a I r(6 + ic) 

Equation fl77|) is equivalent to Eqs. fl2T|) and fl69l) . Discussion on the information entropies 
presented in Sec. 3 may be applied also to this model. 

Quite recently we have investigated the effect of spatially correlated variability on the 
information entropies in nonextensive systems, by using the maximum-entropy method 
[18] . It has been shown that effects of the spatially correlated variability on the generalize 
Fisher information are different from those on the Tsallis entropy: the generalized Fisher 
information is increased (decreased) by a positive (negative) spatial correlation, whereas 
the Tsallis entropy is decreased with increasing an absolute magnitude of the correlation 
independently of its sign. This fact arises from the difference in their characteristics [16] . 
In Ref. [18], we obtained analytic expressions for the Tsallis entropy and the generalized 
Fisher entropy in spatially correlated nonextensive systems from the g-Gaussian-type dis- 
tribution derived by the maximum-entropy method [TS]. Unfortunately, we cannot obtain 
analytic distributions in the Langevin model subjected to spatially correlated additive 
and multiplicative noise, because we have no analytic approaches to solve the relevant 
FPE, even for = 2 [19]. It is necessary to develop an appropriate analytic method to 
solve the FPE including the spatial correlation in additive and multiplcative noise. 
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To summarize, we have discussed the stationary and dynamical properties of Tsal- 
hs entropy and generahzed Fisher entropy in the Langevin model subjected to additive 
and multiplicative noise, which is a typical microscopic nonextensive model. By employ- 
ing the dynamical solution of the FPE, we have derived analytical expressions for the 
time-dependent information entropies, with which model calculations of their responses 
to applied pulse and sinusoidal inputs have been performed. The analytic g-moment ap- 
proach to the FPE developed in I is useful and applicable to the Langevin model which 
includes the time-dependent model parameters [15]. It is possible to generalize the mo- 
ment method to the FPE for various types of Langevin models, which will be reported in 
a separate paper [20] . 
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Appendix A: Evaluations of averaged values 

Various quantities averaged over the distribution p{x), which appear in the Fisher 
information, may be evaluated with the use of Km defined by 

— ^2ctan~^{ax) 



Km = Km{a,b,c 



3 f/b+m 

y/^T{b + m)T{b + m- 1/2) 



dx. 



(Al) 
(A2) 



a \T{b + m + ic)p 

where U = l+ax"^ and Kq = Z. Taking derivatives of Eq. (lAll) with respect to parameters 
of a, b and c, we obtain 
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-E 
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In U tan 



+ 2a{b + m)E 
~^(ax] 



x^lnf/ 



f/m+l 



2cE 



xlnU 

JJm+l 



= -Aa{b + m)E 



x^tan ^iax) 



JJm+l 



+ 2E 



X 



Ifm+l 



+ 4cE 



xtan {ax 

f/m+l 



From derivatives of Eq. (\A2\\ with respect to a, b and c, we obtain 
din Km 



da 
din Km 

db 
din Km 

dc 
d^ In Km 

da^ 
d"^ In Km 

db^ 
(9^ In Km 

dc^ 
d'' In Km 

dbdc 
d^nKm 
dadb 



1 

a' 



ic] 



i){b + m) + '4}{b + m - 1/2) - 2Re '4}{b + m + 
2 Im %l){b + m + zc), 



i)'{b + m) + i)'{b + m - 1/2) - 2 Re il)'{b + m + ic), 

2 Re ip'ip + m + ic), 

2 Im il)\b + m + ic), 
d^K„ 



dadc 



0. 



By using Eqs. (lA3p - (lA20p and the relations given by 



^ = Ifl-i 



1 d^K 



m 



K„ 



Kr, dadb 



Ko 



dlnKm' 
da 



' d In Kr, 



+ 



lnK„ 



, (AT) 
(A8) 
(A9) 
(AlO) 
(All) 



(A12) 

(A13) 
(A14) 
(A15) 
(A16) 
(A17) 
(A18) 
(A19) 
(A20) 

(A21) 
(A22) 



--^ L \ / \ / \ dadb ^ _| 

we may calculate averaged values of various quantities, whose results are summarized 
the Table 1. 



m 



Appendix B: The Langevin model with cross-correlated noise 
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We assume the Langevin model subjected to cross-correlated additive and multiplica- 
tive noise, which is given by Eqs. dl])-© but Eq. ([7]) is replaced by 



(Bl) 



with e expressing the degree of the cross-correlation. 
The FPE for the Langevin model is given by 



d_ 

di 



p{x,t) 



+ 



-( 

dx \ 



F{x) + [a^G'{x)G{x) + ea[5 G\x)] 

■{[a^G{xf + 2eapG{x) + p^] p{x, t)}, 



p{x,t) 



.2 J dx"^ 

where = 1 and in the Stratonovich and Ito representations, respectively. 
The stationary probability distribution p{x) is expressed by 

F{x) + / 



Inp(x) 



a^G{xf + 2ea(3G{x)+ (5^ 



dx 



1 - I j In (^- [a^G{xf + 2ta(3G{x) + 



(B2) 



(B3) 



For the linear Langevin model given by F{x) = —Xx and G{x) = x, Eq. flB3l) in the 
Stratonovich representation (0=1) yields the stationary distribution expressed by Eqs. 

(ESD-dTl. 
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Table 1 Averaged values of various quantities: E[Q[x)] = J p{x) Q{x) dx 



Q{x) 


E[Q{x)] 


X 

x^ - (E[x]f 

1 /TI 
i/ U 

x/U 
x/U^ 
Inf/ 

{InUf - {E[lnU]f 
tein~^{ax) 
[tan-i(ax)]2- (£;[tan-i(ax)])2 


c/a{h-l) 
(6 - 1 + 2c2)/a2(6- l)(26-3) 
[(6- l)2 + c2]/a2(6-l)2(26-3) 

h{h + 1)(26 + 1)(26 - l)/4(62 + c2)[(6 + if + c^] 

c(26- l)/2a(62 + c2) 
hc(2h + 1)(26 - l)/4a(62 + ^)[{h + l)^ + c^] 
-[^(6) + ^(6 - 1/2) - 2Re ^(6 + ic)] 
^'{h)+i)'{h-l/2)-2Rei)'{h + ic) 
Im ■0(6 + ic) 
Re'0'(6 + ic)/2 



(f/ = 1 + a^a;^) 
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Figure 1: The a dependence of (a) diagonal and (b) off-diagonal elements of the gener- 
alized Fisher information matrix G with /3 = 0.5 and / = 1.0. The /3 dependence of (c) 
diagonal and (d) off-diagonal elements of G with a = 0.5 and I = 1.0. The / dependence 
of (e) diagonal and (f) off-diagonal elements of G with a = 0.5 and P = 0.5. In (a), (c) 
and (e), solid, dashed and chain curves denote gaa/5, gtb and gcc, respectively: in (b), (d) 
and (f), solid, dashed and chain curves denote gab, gtc and gac, respectively. 



Figure 2: The time-dependent distribution p{x,t) in response to an applied pulse input 
given by Eq. (l58l) : solid and dashed curves express the results calculated by the g-moment 
approach and the PDE method, respectively (A = 1.0, a = 0.5 and /3 = 0.5). Curves are 
consecutively shifted downward by 0.25 for a clarity of the figure. 



Figure 3: (a) The time dependence of /ig (the bold solid curve) and (t| (the thin solid 
curve) calculated by Eqs. (l3Tl) and ( l32|) for an applied pulse input / (the chain curve): 
dashed curves denote the results of the PDE method: <Jq(ty is multiplied by a factor of 
five, (b) The time dependence of Sg calculated by Eqs. ( l38l) and ( 139|) (the solid curve) 
and by the PDE method (the dashed curve) (A = 1.0, a = 0.5 and (3 = 0.5). 



Figure 4: (a) The time dependence of diagonal elements of the generalized Fisher infor- 
mation matrix G in response to a pulse input given by Eq. ( l58l) : gaa (the solid curve), 
gbb (the dashed curve) and gcc (the chain curve), gaa being divided by a factor of five, (b) 
The time dependence of off-diagonal elements of G: gab (the solid curve), ghc (the dashed 
curve) and gac (the chain curve) (A = 1.0, a = 0.5 and j3 = 0.5). 



Figure 5: The time dependence of the inverse of the generalized Fisher information 
matrix, [= {G~^)ij], in response to a pulse input given by Eq. flSHl) : haa (the solid 
curve), hhb (the dashed curve) and hcc (the chain curve), hhi, being divided by a factor of 
twenty (A = 1.0, a = 0.5 and p = 0.5). 



Figure 6: (a) The time dependence of fig (the bold solid curve) and cr^ (the thin solid 
curve) calculated by Eqs. fl^ and fl5^ for an applied sinusoidal input / (the chain curve): 
dashed curves denote the results of the PDE method: <Jq(tY is multiplied by a factor of 
five, (b) The time dependence of Sg calculated by Eqs. (l38l) and (!39|) (the solid curve) 
and by the PDE method (the dashed curve) (A = 1.0, a = 0.5 and (3 = 0.5). 
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Figure 7: (a) The time dependence of the diagonal elements of the generalized Fisher 
information matrix G in response to a sinusoidal input given by Eq. (!59l) : Qaa (the solid 
curve), (yffeb (the dashed curve) and Qcc (the chain curve), Qaa being divided by a factor of 
five, (b) The time dependence of the off-diagonal elements of G\ gab (the sohd curve), gtc 
(the dashed curve) and gac (the chain curve) (A = 1.0, a = 0.5 and j3 = 0.5). 



Figure 8: The time dependence of the generalized Fisher information matrices of (a) gxx 
(the chain curve) and gfj,^ (the solid curve), and (b) g^^ (the solid curve) in response to a 
pulse input given by Eq. ( l58i) (A = 1.0, a = 0.5 and f3 = 0.5) (see text). 
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